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Introduction ' ^ . 

A. Purposes, of This Paper ^ { * ' . 

' ■> * 

' This session of the seminar, vms e'stablished for at least thr'ee distinct 

reasons, The primary purpose is to present an overview of the appTica- . . 

tions of analytic techrfiques ^nd managenient- information in_ the"^ performance 

of academic planning in state-level postsecondary education agencies. To 

this^end, this paper heroically attempts the impossible.' It is designed 

to be responsive to the needs of a variety of academic planners, including 

both those with little previous exposure^to an^alytic and informational * 

approaches as v/ell as those who are at the 9<jtt]ng edge in the' development 

1 

of such approaches. The paper also is designed to acquaint the practi- 
* tioner with these various' techniques ih^a generic sense and to provi'de 
information about specific products or tool s* whicff are currently available. 
Owing nothing to their generic nature, but rather deriving from the locus 
of the authors , particular ^and perhaps undue) emphasis will t?? given to ' 
those products availaty^ thrpugh- the National Center for Higher Education . 
Management Systems 

A second reason for this session concerns the 'evaluation of the available 

' . \ • 

• technology. xVJhile the paper includes some evaluative comment, we are 
anxious for members of the* audience to sha^re their experiences- with , and 
their assessments of, the various approaches whtch we will discuss. 



The final purpose of ^h'ts, session is to provide a forum for the discussion 
of needed development in these* areas. Our paper will describe the results 
of a recent NCHEMS assessment of developmentaT needs, both in terms of 
requirements for new types gf products as well the desirability of 
reorientation of existing tools. As vn'th the/evaluation theme previously 
discussed, it is hoped tha't our comments will provide a springboard for 
audience discussion oh product development. 

.;. . . ' ; ■ • ' i- 

Relationships Between tne Conference Theme and the .Topic of This Paper' 



Most of us will recognize that the conference" theme , "The Maintenance cf 
Academic. Qua! ity 'in a Time of Uncerfed^ty", is a-most timely one." Several 
key words in this conference theme are useful in relating the purposes of 
uhis particular session to that of the overall' con-fefence. The term 

» I , . ' . < 

"maintenance" • impl ies managing on an ongoiffg basis. In turn, this suggests 
that monitoring would be a common activity to^rd this end. The process 
of monitoring requires the acquisition and ^anal^sls of inform.ation to ^ 
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determine that the planned cours.e is being maintained. 

• "Quality" suggests 'assessing or measuring gainst seme predetermined or 
desired standard. Quality frequently has b$en- measured with operational 
data, e.g. ,^ student teacher ratios ,^al though ^tiora-'recently there nas 
been 'a t^end toward the- collection and. analysis of irvformation about the 
Quti comes of. academic programs rather .than focusing exclusivel/y on opera- 
tional characteristics. * ^ - * 



The "time of uncertainty" ^erm is both the kfey phrase in the conference 
theme and offers the strongest link to this particular session. The term 
implicitly suggests the acknowledgement of an unknown future. Those who 
wish to manage and'prepare (maintain (ifuality) for this uncertain fate 
must develop projections of the alternative futures possible and analyze - 
.{he state, of the enterprise under -many various 'assumptions . Generally^ 
data and information are used to describe these future conditions and 
analytic techniques "such^as the use of simulation models to understand 
the relationships of various 'emerging trends. Jhus, v;e believe our topic 
is of the utmost relevance to those who wish to aggressively pursue "the 
maintenance of academic quality in a time of uncertainty". 



Characteristics of State-Level Academic Planning Which Require* Inforrfiation 
and Analysi? - ' . • 

Compared to academic administration al other levels, there are severaV 
characteristics unique to the state level which require a greater reliance 
on informational and analytic techniques in academic planning, for 

^ \ ■ • ■ - 

instance, ar^ academic department\chainnan is able to make many decisions 
based' on a first hand' knowl edge and* observation of the operation. Through 
personal contact, the chairman knows how many stlidents are graduating^ how 
many are expected in the new' class, how many faculty are planning retire- 
ment or transfer, and how much salary to pay faculty to remain^ competitive 
in the field. The^state-level academic planner possesses few, if any, of 
these personal insights due to the sheer volume of th,e operation! alone. 



Instead, tFie state-level planner must rely on impersonal; cofr.parati ve ^ 

^ data to^ monitor and to assess activities in' these same-areas unless he 

' ' ' 1 

can build n$tv;orks among the'iisers and providers of informationr 

Most state agencies usually are expected to treat constituent institutions 
on an objecj;jve basis. Whi\Ie peer review ha^ beea employed in certain 
types of decisipn"s, and perhaps rr^t frequently to provide^for qualitative 
assessments, generally the dri^'e for objectivity translates into decision 
' making- based on quantitative criteria. Such quantitative information 
takes many^'for^ns ranging from the use of raw data to the application of 
^ analytic techniques. - ' a / 

Fina^lly, the state-level postsecondary education agency is expected to'- 
perform a dual r£)le.' While for many purpose'l it is considered'^part of 
the a'cademy, its^other role, that of being an agency rif'^tate government, 
generally requires; it to-intearate postsecondary education activity with 
. that from other governmental programs. Xhis usually is accomplished by 
translating postsecondary educatiofi information into much more general 
formats which are descriptive of overall governyien^Vl (purposes.. This,, 
In ^ffeot, allows the goYernor and other stj^te government officials to 
treat th^ various state agencies with the same ohjectiyity that the state 
.posts^cond'ary^ education agency attempts to employ ,in its Relationships 
with the academic institutions. 



Hefferlin and Phillips made a similar pdint in their discussion of the. 
^^dm-ini strati v? problems resulting /rem i'nadequate-informatioa in rapidly, 
growing institutions (Hefferliii and Phillips, pp. 2-3). 
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Changing Trends. in State-Level Academic Planning ' ^ . , 



. Theja-st decade has seen significant shifts in the . typ6s .of • activities 
^ engaged- in by state-level acad^ic planners. Only ten years'^ag^ most 
of us were concerned with understanding and responding to growth. 
Planning topics included opening new institutions, expanding degree 
offerings vdthin existing institutions, and building'Yiew fac-ilities. 
Although different states are encountering somewhat different trends, 
most of us "do not experience such situations currently. Instead, the 
emphasis responds to the economic concept of scarci ty--whether it is 
the scarcity of funds or the scarcity of students. This recognition 
jias led to mare thorough evaluative activities and to a great£r emphasis 
on articulating institutional purpose, iMost: would agree these new 
varieties of plann^ing activities are much more difficult from both the 



technological and the human behavior perspectives. 



Just as the emphasis in academic planning has shffted, so have the trends 
\r\ informational and analytic techniques. A decade ago the* relevant 
topics'were enrollment projection models ,* facil ities construction models, 
and procedures to evaluate the readiness of new degree progv^am^. Newer 



2 

Millets discusses these trends in terms of the demands being 'placed upon 
Chief- executive officers of state boards (Mille^ pp. -67-58). . 

"^An interesting parall-el , d^cribed by Orlans, is %e attempt Bf ^prestigious 
commission to plan for the year. 2000. T.he Commission's initial vork was 
premised on a vision of an expanding economy which did ROt evolve. Thus, the 
efforts to optimally invest the ''fiscal dividend" that derives from economic 
growtji we're not helpful when the problems were recession, inflativon, energy 
shortages and the fiscal burdens of establishea social -programs (Orlans, j 
pp. 30-36.). ' 
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techniques are also concerlied with many o^ these same topics, but the 
'.approaches are now much more complex and sopisticated. Enrollment 
models are expected to Be .mucK more precise, .more responsive^ to a wider 
variety of predictive factors, and more specific at greater .leve.l s of 
detail, in projecting future students.' PrOgy%af« review techniques now 
encompass the assessment of existing prag^ams with the results of such 
studies frequently leading- to program consolidation and, in^some cases, 
. even closure. Jks in the enrollment projection example, the inforaation 
needed to determine the desirability of cFosing an academic program is 
expected to much more accurate and in much greater detail than that 
whicji was'^sed for deci^ding on program ejjcpanston. Modeling techniques 

have grown from simulation approaches to optimization methods where 

> ^^^^ 

planner is trying to achieve a maxi'mSl outcome with .limited resotirces. 

Changes in informational approaches to decisior^ making are resulting 

, not only from the .changing requiresients of state-level academic planning, 

butslso from changes in information technology "itself-. Indeed, as a , 

recent IBM advertisement n6tes, we are now entering the ^inform^ition $ge. 

'*Huinan history has long been described in terms of ages whose names 
^ . refleqJt th.e staged of development through which nran'kind nas passed: 
the S?OTie Age, the Bronze Age, the Iron Age and sc Qn-~^owri to the 
Industrial Age, which established the foundation of our modern 
society. 

Today ;-there is growing agreement that we have entered a new era, 
' a post-industr.ial, stage of development in which the ability to put 

information to use has become critical, not only to the essential 
^ production of goads, but to efforts to provide a better life to 
» the individual , as well. 
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Callan suggests^, that pfpgram review activities will need to be especially 
rigorous to provide just-ification to the legislative arK^ ^executive branches 
(Callan, p. 18). . " . r ^ 



♦ 

/This new era is being referred to with increasing frequency a^ the 
Information Age. 

^' Changes in our perception \)f information itself--i'ts nature as w.elT 
as its scopes-have accompanied this profound shift of emphasis in 
our society". ( Saturday Review , June 11, 1977, pp. 22-23.) 

In this paper we will attempt lO discus's these tren(;ls .in inf>onnational 

support for academic p'lanning in more specific terms and to focus on the 

direction of changesto come. 

A Framework for Analysis of Informational Techn-iques 

As the previous paragraphs implied, application of informational and 
analytic techniques has been and continues to experience stages of 
development. For purposes of 'this paper, it is useful to consider infor- 
mation to be comprised of^at least two distinct parts." First, there is 
the raw dat;a itself. For the academi^^ such raw data might 

include such data elements as the number of students, the number of 
student credit hours taught, the number of faculty, faculty salary expen- 
dtj:ures, the number of Vibrary volunles, or the number of degree programs. 
For a limited nurpber of purpos.es, data alone are sufffcient for the plan- 
ning need. ■ ' ^ • 

Data, hov/ev^er, can increase^in utility through the application of analyti 
techniques, the second component ofT)ur framev/ork. Analytic techniques 
can v-ary according to their complexity and sophistication. At th6 lower 
end of' this continuum, such anal'yses as average faculty salaries, average 
student loads, student/teach'er ratios, and other descriptive, statistical 
relationships between data elements are common as^measures of phenomenon 
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considered rel evant 'to^ different decisions. The middle range of sophistiV 

cation or complexity is characterized^iy such activities as faculty activity 

analysis, induced worUdad maftrites, and facilities utilization studies 

whene the planner seeks to analyze the operations -o'f the institutions and 

the academic programs in the institutions. Among- the more complex types 

Qf analyses are simulation stu^fes, where many types of data and analytic 

techniques are brought together tfc examine their interrelationsi^ips , and 

optimization studies which empToy linear programming ,\ goal *program.7iing , ^ 

and othq/ advanced mathematical techniques. 'It is important to* note \ 

tHaf a ^third component of j'nformation exists, namely opinions, values, 

, "and other subjective assessments. While this paper does not deaU directly 

with this category'of information, the underlying prepiise of this paper is 

^< ' • • ' 

[ that quantitative information and analys^is is effective to the. extent that 

i 

it supports, rather than supplants, the use of judgement 'in 'decision-making. 



} 



In the next two sections v/e will attempt to provide brief summaries about 
(1) types of data and data structuring conventions, and (2) th^ various ' 
levels of analytic activity. As part of each sufTmarization , we will 
discuss both current and planned NCHEMS activities related to the particu- 
lar topic and the better known products deyeloped by other researchers.. 



H. Data and Data Structures for Academic Planning 

^ A, Issues Concerning'Data Collection ^ , ^ ^ 

^The planner who engages in' data collection faces a number of is\ues 
concerning v/hat data^to collect and how to collect it. These issues 
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'include t^^chnical considerations, analytic 'considerations, and concerns 

' - 5 

for the relative roles of the agencies and institutions involved. The . 
identification of what information to collect for planning anci how to 
collect it rests fundamentally upon some explicit or implicit conception 
of a planning process and of the role that information'^l 1 pT^in such^ 
a process. There are various trade offs to be^considered in data ctollec- 
tion and analysis thatn'mpose -different costs on both the providers^and 
users of information. This is perhaps the least v/ell developefl amd most (, 
frequently ignored step in planning for the collection and use of infor- 
mation.^ ^ 



Most statewide planners find that "snapshot" data' is sufficient for tFieir 
purposes.'^ Such point in time datafe.g., enrollment as of October 1, as 
compared to on-line operating data, is often considerably cheaper to gbtaipu. 
and is reasonably accurate since institutions tend to have much 'the ''same 
characteristic^ for a 'semester, or even a^V^ar, at a time; An.^issue where 
state agencies are more divijjed concerns .the collectiorKOf sqmmary versus 
individual-specific data, -P^ipponfents of indivi$|u|l-specific collection 
(individual 'student enrollment data, individual faculty salary and' * 
activity/' dat*, etc.) cite the advantages of not being c.anfdned to a'ny^ 
particular data structure and being able to reorganize the data for any 



5 

■ Vfellman provides a good discussion of problems in. developing state-level * 
management i|rfonnatlon systems (Wellman, ^pp. 114-T15). ♦ ^ ^ . * 

For an example of 'an initial attempt at articulating, the assumptions under- 
lying the development ©f an information base and for 2e description oj" refinements 
" that are stil Wequired in individual s-tat^s, the reader may w.ish to review 
Chapter^ I, IT, and' III of (Jones, et. aU, 1977). 



pol^fcy issue that arises.. Proponents of sununary data collection 
frequently mention that this approach pr-^vents the'st^te agency from 
assruming institutional iiianagement per^gativp^f and the cost of data • 
collection is rninimized. - ^ . - » " 

Another set of related data collection-issues pertains to the quality ^ 

of the'da.ta. Data quali^ty concerns include validity, reliability, 

» . «' 

'accuracy, and comparability.- Xhe validity question focuses on whether ' 

thp data *element measures what U v/^s * intended' to describe. The 

accuracy issue is concerned'wi th the correctness aod- precision of the * 

data. Fpr.data to ,be- rel iabl e, one would expect that if :^he sa:?ie'data 

*» * ' ' 

were sought more than once, the ansvi^r would be the same each time, ^ ' . 

' ; . ' • • 

' Fi'nal'ly, the concerns for data comparability ,adt!res^ an issue, which is 

«:ia-l ly 'important at the'^5tate level, namely 'when col.ljpcticig data ' 
twa different sources;, does it .d'escrTb-e a similar subject in 'a 
.similar way? Givien tliese <^ata *qual¥ty ^objectives , ther^ are"* several 
steps which can be taken/ * In ^iH^mptln^^ to'cbUe^t data, the planner^ 
sl)oa>d' attenipt to' provide definitions which are mutually exclusive,* 
do* hot require significant judgement by the' 'data pro^ider^ and have been 
agreed to by the ^dl lectors and providers. 



Another major issue in data collecti-on -for the state-le^)el academit . 
planner, concerns the timeliness of th*e information. ' WKiL? data. can be 
a particularly valuable resource in planning, ijts utility is greatest 
when' it^ is available at^the time when' it is. "needed.* ' The planner- may 
enhance th*e probability of rgceiving., timely^tnformation if he establishes 
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data cdl lection plans .and schedijles which enable integration* of data ■, 
rep9rting systems with operational management systems and/o^planning • 

^systems and allow providers' to anticipate needs with sufficienf lead "• 

L • 7 ■ «• . • 

iime. . • '. 



finally, an iss^e of major importance concerns the cost of the data ' 
'clcllection effort. ; The pl'anner must ask himself if" the cost of the data 
collec'tion effort that is incurred by both Ihe collector and the provider 
is warranted by the potential use. Data coVlection costs are minimized 
when the data collection plan remain^ stable oyer a reasonably long 
period of time and the -collection plan is integrated with other^"'data 



■Sollection efforts. Not incidentally, use of these same criteria generally 
increases the accuracy of "the data- col l\cted^ ' " • 

^' ^^^^ ^^^^^^ ^° Academic Planner 

s 

> As we noted in the previous section, the data required for academic 
. planning is derivative of^the specific process that is used. Nevertheless, 
it might be pos'sible to generalize that data for academic planning can be 
collected in two differei>t ways. On the one hand, data can be pollectec} as 
part of a specific planning process or activity sgch as program review- 
k.e., for each program, proposed, there is a typical set o1^ data that 
program proposer is required to, provide. On the ot^e-r hand, many states 
have on-going data collection processes, often centralized in 3 specific 
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InK'^Jf I'V^ ' management information systems master plan and insuring 

JJfn^.Hh 5 ''o"'' 'I 1^°^'^ ^'^-^ ^'""^ P^P^^ ^'^^ the Management 
Information Systems Research Center (Schroeder, 1975, pp. 15-17). 



off.ice, with such "data being used to support ^a variety of state-level ' 
planning and financing activities,, among them being academic plarimng. 



There usually are similarities betv/een the generiq kinds* of data 

collected through these two different processes, but the specifics of 

the da.tS o'ften differ. Although the criteria for .program review are , ^ 

stated differently from state to statfe, generally they deaT with issues 

related to the need for the programs, the extent to which the need can. 

be fulfilled in other programs existing in the state, -"ffie anticipated 

costs for initiating or carrying out -the program--^easjred both in terrriS 

of oppor*feunities forgone, as well as program specific costSp and an^ 

indication of the pur[^ses (benefits) to be' served by the program. 

To this end, ini^ormation in specif ic' ne',^ program proposals is typically 

req\iested that v/ould reveal'how many students might enroll, jvhat courses 

♦ * 
are required for the program, what faculty will be used in the progr^am, 

what equipment is required and its availability documentation of the 

relationship of the program to other programs in the institution and to 

the overall institutional mission, the sources of funds available. to 

support the program, and so forth. ' 



On a broader level, information is, or might be systematically collected 
by the agency tha,t v/dUld' support the program review and. their academic planning 
processes. 0"n^' attempt to conceptualize such a general izea information 
base has been initiated by MCHEMS. It is called the s"tate Level- 
Information Baise Project- (SLIB) find is currently beginning the third 



V 
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year of a four year project. Organized around four issues relevant to 
state-level 'postsecondary education pi anning--What is the need/demand 

for post§econdary education in a state? What programs are required to' 

meet this need? What resources are available to supply these programs? 

How should these resources be f inanced?^-the project identifies a proto- 

typical set of information that a state, adapting it to its own environ- 

mental circumstances and statutory responsibilities, might wisfx'to collect, 

on an on-going basis. Aspects of this infonnation set that might be 

relevant to the academic planner are data about students, faculty, 

aeademic progranjs/acldemic support, and institutional finances. 



Students are described in various ways. The planner frequently has a 
need to know how^many students are full-time versus, how"" f??any are part- 
time, ite usually wants to .know the major field of study of the student 
and the degree sought.* For many planning purposes such student descrip- 
tive data as his age, sex, and race are important. It is often helpful 
to. know The geographic and institutiortil sources of the student body an<i 
the successes and/or failures which the students expX^ience after their 
educational preparations. Similarly, facu-lty also may be described in 
terms of the extent of their effort and their personal characteristics.^ 
Additionally, it is useful to know their tenure status, their educational 
attainment, their disciplines of expertise, their current assignment, and 
their salary and rank. ^ ' ^ 
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Funded by the W, K, Kellogg Foundation and the f!ationa\ Center for Education 
Statistics, information that, has been identified as use^l for state level 
plajlining .is currently being pilot tested in ,Ca,l iforriia , Hav/aii, Illinois, , 
Kentucky^ flew Jersey,, New York, South Carolina aind Virginia. For ajiditional 
information about this project, see McCoy (1977rfor an overview of the project, 
and Jones, et, aL (1977) for a detailed discission. 

■ ' 15 . , 



Program data are included ^that provide both descriptive measures and 
quantity. indicators. Data elements suggested to describe programs 
include program inventory information (by student degree level and ^ 
discipline for instruction, by discipline only for researci^ and public 
service activities) . v Progfajnj'nformation to describe, activity level 
includes the 'number^ of credit hours taught in each discipl ine' and the 
number of degrees av/arded. Frequently, academic support data ^Iso are 
useful for planning purposes. Data about th^ 1 ibrary .col 1 ection , audio- 
Yi|ual and computer "equi pment utilization, and laboralory capabilities 
add an important dimension to many academic plajis. 

•Because financial information increasingly is becoming a concern of the 
academic planner in assessment and resource allocation, the financial 
data about salary levels, instructional cost3 and tuition in SLI3 might also 

r 

relevant. Financial' data associated with'many of the academic 'support 

i 

progranjs i^ also included. * ' - 

SI 

* 

A frequently overlooked aspect in data collection for academic plannfng 
concerns those data which do not describe the individual institutions .but 
rather d'escrit^e the state'or region at' large. In performing access 
Studies, information -about the state ',3 population including the number ' 
by region, -by age, by sex\ and educational level are important. *fle'^s 
assessment studies Vequire, not only population data, bgt also information 
depicting manpower trends. As a counterpart to tflTTnstitutional finance 
data which is important to th'e academic planner, information concfe^^ning 
the state's wealth is also importan^t.. Typical data collected for this 
purpose includes tax base, income distributions, and income trends. 

i6 - . ■ ■ 



C\ Sources of Data ' , ^ ^ 

\ 

The same 'framework for, describing types of data (institutional and non- 
institutional) will be used to suggest where the academic planner might 
^ obtain information/ Institutional data may be acqu^irecj either directly 
or indirectly. In^turn-, direct data collectiori from the institutions 
can be on -either a recurring or non-recurring, special study basis. '"Many 
States, with an interest in^reducing data 'coll ection costs, are tu^nir>g 
to more indirect methods of data collection.. This is accomplished in the 
^ development of the data collection plan by recognizing that the institu- 
tion^ already have to reporf^data to other agencies. Many state agencies 

now* automatically receive copies of institutional Higher Education General 

f \ 9 * 

Information Survey (HEGIS) reports and survey responses to the studies 

conducted oy the Anierican Association of University Professors, the 

National Association of State Uriiversi tiss and Land Graat Colleges, and 

'other similar organi'zations and agencies.- When timeliness is not a con- 

cern, the planner^also can obtain-data from the national Center for 

- Education Statistics after ^they hav.e prpcessed, edited, and published the^ 

HEGIS reports or prepared the EDSTAT data /base. 

■ . / V ■ 

The sources for non-institutional data are as varied as the type of data 




sought. Within state government, such agencies as the State Pl^inning ' 
Division, the State Economist's Office, or^tlie Bureau of Business and - 
Economic Research are likely sources^of needed data. At the i^eral fevel , 
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Fdrfithe 1976-77 HEGIS Submission, ins titutional, responses wQre coordinated at 
the state level .in 32 states. Ten additional states experienced pa^'tial state 
level coordination. (See NCES, "Requirement^ and Specifications Manual", pp. 
M8.) 

_ / 



V 
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the U.S. Department of Cbnimerce's gureau of the. Census collects an%reports 
considerable 'data concerning the nati'on's population. Census reporfs 
describe^the population, by Iqcatian, race*, sex, income levels educational 
attainment^ and 'the nany combinations thereof. Also the Census Bureau 
collects much 'information about state and local governmental finance. In 
the U.S. Department of Labor,^ the Bureau of Labor Statistics is a source 
of mucli manpower information v;hicl7 i^s useful for ^ose performing ^needs 
assessment studies aad en'rollmeni projections. 



D. Existing Standardized ConVentions for Organising Data for Academic Planning 
and Analysis ^ \ 

Data frequently \s collected along organizational lines, and for many 
purposes this is an appropriate approach. However, there are other 
occasions when staadard.iz.ed conv^tions are^more u^ful , This is 
frequently the case when program planning or data comparison is the 
object of the activity. In this section^ we will describe standard data 
tollection co.nventions f-or institutional activities (and academic programs 
in particular^, for finances, for manpower, for facilities, for institu- 
tional environment, for institutional goals, and for student outcomes. 

The Program Class-ificajiion Structure(PCS) was dev^eloped by NCHEMS (Gulko, 
1972), in the early 1970^s to facilitate planning and financing or\ a 
programmatic rather than organizational basis. The PCS is now uncJ^going • 
field review for its second edition (Col 1 ier ,*'T976) and describes institu- ^ 
tional activities 'in- eight broad programmatic -areas : instructlcfri , organized 
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researcti,. pub! ic service, acabemic support, student services, institutional 

support, student access, and independent operations. *Addi tionally , there 

are , conventions for categorizing data at-the sub-program level within each 

of these seven programs. The academic programs (instruction, research, and 

service) may further be described through the use of the HEGIS Discipline 

Taxonomy (^luff and Chandler, 1970). The HEGIS Taxonomy includes over 300 

.distiplines which-can be aj|jregated into 30 d-iscipline categories. The 

Pragram Classification Structure incoroorates the HEGIS Discipline Taxonomy 
r . ' 

at the data element level. 

The "bible" for financial data collection is the report of the Joint 
Accounting "Group. Members of the Joint Accounting GrolSR^(JAG) represen- 
ted the National Association of> College and University Business Officers, 
the American Institute for Certified Public Accountants", and NCHEMS. In 
^74, the Joint Accounting Group issued a neport (Collier, 1974) endorsing 
conv^entions for the collection and reporting of" financial data based both 

/the programN^onsiderations reflected in the program classification 
ucture and or the fiduciary concerns df business officers and auditors. 
Additionally, each organi2;ation issued their own report focused on the ^ 
unique needs of their constituencies (Committee on College and University 
Accounting,.'! 973; NACUBO, 1974; Collier, 1975). Each of these separate 
publications is consistent v/ith the principles developed by^-JAG. 

• ■ ' ) 

Although higher education generally is acknowledged to be a labor intensive 
industry, a standarS^nvention for reporting manpower information has not 
existed until recently. A National Center for Education Statistics publica 
tion>.- A.Manual for Budgeting ar^d Accounting for Manpower Resources in 

, . '19 . . - 



Postsecondary Education (Jones and Drews, 1975), has been developed in 
recent years ..under co/itract wi{R NCHEMS. Fortunately, there is more 
standai^dTZctticvi in reporting on other institutional resources. The ■ 
Higher ^lE^dudation Facil ities ■ and Inventory Classification Manual CRomney, 
1972)', developed by.NCH^^^S, 5ervas as.^a ^reference .for reporting f^cili- 
;.ties' dat:a to the Federal Government^^rough ' 

The Educatic^nal^esting Service has been he^vi^ly involved in developing, 
conventions for collecting 'data' on institutional environment and insti- 
tutional goals. Their Student ReaG^4^s to College (Warren and Roel/s, 
19721, Institutional Functioning InventoVy (Peterson, et. al . , -1970), and 
Institutional Goa'ls Inventor/ CPeterson, .1970) are- suggested for thej 
planner vnth these intej^ests. Similarly, the American College Testing 
Prbgram h$s developed a product called the Institutional Self Study 
Service that addresses many of the'se topics (Lenning, 1970)." ' 

The past five years have seen increased j'nterest injearning more about 
student outcomes r NCHEMS has done .extens ive developmental work in this 
area and has published the Outcomes Measurement and Procedures Manual 
CP4*i^k, et*. al., 1975)'which enabled planners to select outcome measures* 
appropriate to the particular planning purpose. Based on experience 
gained with the Ij^anual and from additional iork, NCHEMS currently i6 
developing a set qf^student outcomes questionnaires ,targete(^ for specific 
institutional sector audiences to facilitate longitudinal outcome studies 
In the context of the SLIB 'project, two states (Hav/aii and Rhode -Island), 
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are focusing on -the .use of outcomes infonnation it) state-level ^pl an'ningi 
The Hawaii pilot test is investigating how putcoines information might 
be-used to allocate- budgets to. institutiot^ , , and Rhode Island is explor- 
ing the use of outcomes iriforniatiph to measure progress in achieving 
state. pbstsecondary*eduqation obje|^tfv£S. ^ 

jhy^ee more recent proo^.cts curr^tly are underj^ciy, each of which is 
likely to Have significant^ impact on the structure .of data to be collec- 
.ted* a^t "the state level. These are the- Subject Matter Taxonomy project 
conducted by Educational Management Services (EMS) of Minneapolis, and the 
Adult and Continuing Education Taxonomy project and the State-Le^eT • i 
Information Base project which are both under-'/ay at NCH^MS. As cfimparsd 
to the REGIS Taxonomy^f Student )1ajor Programs^ the EMS project is 
designed to develop a structure fqr des^ii^ng subject matter.. This 
project has been undeic^/ay for several ye^rs and intends t^ develop a 
taxonomy for all levels^Of ^education. The final report bf tne project' 
i^ due to be submitted to. it3 fuodor, the )latiojial Center for Education . 



Statistics, in late July, 1977. . ' ' ^ 

/ . 

As the Federal. Government and state agencies broadened th'eir perspectives 

from higher education to include all of postsecondary, edj^cation, they 
became aware that there was no convenient way to categori'^e much of -the . 
data relating to adult and/or con.tinulng education. Under contract with 
NCES, NCKEMS' has. recently developed a first draft of su€h a*,st?ructure' and 
Currently is conducting an extensive series of f^eld 'reviews in various / 
sections of the country. The W. K. Kellogg Foundation has funded another 



NCHEMS, project to develop principles^ffnd procedures for assembling a 

'Stlte-Level Information Base (SLIB). .While SLIB (Jones, etr. al . , 1977) 

is being designed- to respond specifically to planning issues at the 

state level, it is built from many previous NCHEMS projects, most of 

which hB.ve been descVibed above. ^ The Program Classification Structure, 

th^ HEGIS Taxonomy, the report of. the Joint Actouirting- Group,* the Manpov/er 

/ 

and Facilities manual s 'are alUused to describe SUB. . - 



Two other federally funced ^gtivities underv/ay concern ing^<fata collection 
are important to note. The Na^j^onal Center for Education Statistics, 
under contract- with NCHEMS and in cooperation nith the W. K. Kellogg 
Foundation, is funding a Federal Component of the State-Level Information 
Base project. This compon&nt extends beyond the bas/c ^IB activity ^n ^' 
its focus on problems of data coMectiop for outcomes and adult and 
continuing education,^ The Federal SLIB project also is concerned with 
coordinating federal needs for postsecondary education data with those 
at the state level. Inherent in this project is the belief that data 
collection efforts might -be minimized through such coordinat-l^li. MCES 
also has ent^ed into, coqtract wil^h the *S.tate *Higher^Education Executive 
Officers (SHEEO) Association. * The perpos'e' of* th.fs ^o/itract is to 
develop a network^of sta^-leVeVdata ^.prov'iaers. ^ This network and its 
Steering committee, the Postsecoadary^ Education Rolicy Committee on 
Information (PEPCt), is or wil^fe^b^e addressing such matters as state-level 



data collection and editing before transmittal to the Federal Government: 
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F. Summary* 

The purpose, of this section hai been to describe the Issues surrounding 
data collection wh.ich face the acadfepiic ^lanne^r, the types of data 
available and their usual sources, and the contentions most frequently 
used in organizfng data for reporting and analysis, ^As such, this^sec- 
tion provides the basics of the data half* of the information equation. 
The next section wl^l address the many analytic techniques available to 
N^he state-level planner for translating data into information for policy 
making. ' ^ i 

Analytic Techniques Used by State-Level Planners ■ - 

A. Hierarchy^ Analytic Approaches / ' ^ - 

As discussed in aa earlier section, the analytic approaches used by 
academic planers at the state level in postsecondary education range 
from the comparatively simple to the highly complex. For the purposes 
'of thi-s paf)er, it is useful to consider three levels of a developmental 
hierarchy of analytic techniques. For discussion, purposes'*, they have 
been designated a^ (1) basic, (2) iniermediate, and (3) compflex aoalytic 
techniques. It is impcfrtant to note, further that there are no'rigid 
crit^ia to distinguish between techniques at any intersection of the . 
hierarchial levels, but rather these divisions suggest ranges along a 
* eo)itinuum. . - ' . — . > ' 



B. Basic procedures are chai^acterized by their tendency toward descriptive 
statistics. Usually the analysis is performed within the construct of 
. an analytic framework designed to provide insight to some problem or 
policy area. At the basic-analytic 'level , yaripus items of raw data 
are arranged together mathematically (ratios, products, sums, or dif- , 
ferences) with'in the framework. Usually, the emphasis at the/ basic 
level is on comparative analysis either across similar {jrgani|zational 
units or for single units aver a period of tifTie\ 

Perhaps the best example of NCHEMS work at this level is the report of 
the Statewide Analysis Project entitled State and Local Financial Support ' 
of Higher Education, 1.973-74 (McCoy, 1976). Iq this publication^ atten- 
tion v/as directed tov/ard comparing the 'level of ^support for postsecondary 
^education across the fifty states, both in aggregate and by institutional 
sector. Additionally, further analysis was directed toward understanding 

fir 

^reasons for the variation in state support and for using different 
measures to examine state support. Included ar^ -demand va'riations 
suggested by the age distribution of the population and by the ab(ility of 
the state to support public services' as suggested by state wealth measures. 
Much of the Information reported in State and LocaT Support has been updated 
for inclusiorNin the State Postsecondary Education Profiles Handbook (ECS, 
et. al '1977).. In addition to the statistical reports , Profiles 'contains 
sections on state structure for postsecondary education and on current _ 
publications and reports. . ^ 

♦ 

Another project just beginning at NCHEMS has tentatively been named the 
Indicators' project. Through this activity, efforts will, be focused on 



further development of an analytic framework for 'describing the status of 
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\ postsecorrdary education within a stBte. Primary , effort vn'll be directed 
toward developing consensus on a set of measures which might be used over 
a pefiod^of time and will gain wide recognition by policy fHakers, Useful 
anal-6gies*'for th6 potential utility of postsecondary educauon indicators 
are the G|ross National Product, the unemployment rate, and the illation 
rate which are used ^to describe the status of key aspects of the economy 
and to evaluate the possible consequences of different policy propo^sal s*. ""^ 

C. Intermediate Techniques ^ * \ ^ . 

As the transition is made' from the lower end of the continuum toward the 

^middle, the types of analysis shift from displaying previously available 

data toward conducting special studies to urxierstand ajdditional aspects 

of the operation. Such ''operations analysi's" may involve special data 

.collection efforts on an ad hoc basis or the development of recurring 
' ~ ' ^ i 

data collection activities. It mig^ht be said that intermediate analytic 
techniques focus on the "v/hy^^and the "how" of the enterprise. 

« . 

' Several MCHEMS activities serve as examples of such mid-range analysis. 
-\ 

First, the Induced^Course Lo^d-^ Matrix (ICLM) and the Induced-Work Load 
Matrix (IWLM) represent a step beyond the typical tally ^of enrollment"^ 
information (Haight- and Manning/1972) , 'In these matrices, one can 
analyze which disciplines contribute support to student major programs 
and, conversely, which programs consume student credit hours from each 



10 . \ ^ 

For additional information about possible uses and develoi^mental prab^ems 

associated ^wi th the development of postsecondary education indicators, see 
Collier (1973), Orwig and Jones (1977), and Van Alstyne and Coldren (1976) 
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discipline. This' type of analysis reveals many' interrelationships amonij 
.academic pr'oe^rams aad course offerings which 'are invaluable in progran] ^ 
planning. • . . . - 

--Two .NCHEMS projects .have led toward developing special data coTTection 
and ana-lysis* procedures. One project,! abel ed the, Faculty Activity ^ . 
Analysis project, developed a framework for describing the ways in which ' 
a facul^ member might spefid his or* her time and deve^ope<i instruments 
^for collecting this information. Recommendations ar^sj:;eported in 
^ Facurty Activity AnalysS-s Procedures Manual (Manning and Rotjihey, 197^^),- 
and Faculty Activity Analysis :» Interpretation and Uses of Data ^(Rlmney 
and Manning, 1974f. As a labor in te^fen've industry, knowledge of how 
the faculty effort is expended is pf^^xtreme importance to th^ academic 
plar^r. As a result of the NCHEMS^ Outcomes program^^the Outcomes^ 
Measureme^nt and Procedures Manual ^Micek, et. al., 1975) f^as b§en aevelop,ed 
'Through use of these techniques, the accpdemic planer can gain a better 
understanding of the effect^#^^ss of the various programs offered by ^ 

^ Or 

the institutions. ^ - 

Dun ng^^^tfj;^ past seveVal years sj:a4:e agency activity in academic program . 
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•review has experieRcedV^ Resurgence of interest, particularly as such 

. • - ' ^* r 

analysis' has expanded to include the consideration of existing programs. } 
Within our framework, much of the 'program Veview actjvity would fit the ^ 
japper range of the intermediate level of analysfs. Th^nrtot?^' successful 
approaches in state-lfvgj program review include attempts Irounddrstand 
^*riterrela*tionships among academic programs, to indicate the quality ^f 
the faculty and to describe how they spend their time, and to measure 
the studerit outcomes of the programs,. 



Complex Analytic Techniques 

'Pit the^ upper end of the analysis coatinuum are tho§e procedures which 
attempt to interrelate many aspects of the program or the institution. 
Frequent objectives in the more complex types of analyses are detennina- 
^tion of Gpst, benefit. ratios, estimation of future conditions, and the 
allocation or 'distribution of (resources,- Among the more complex types 
of analyses are those which attempt to simulate the life of the organiza- 
tional unit under ""s^tudy and those v/hich strive to find the optimal mix 
betv/een the resources and demands for the program. Due to the complexity 
of the analysis and the massiveness of the data, computer models are 
frequently used in performing such higher order^types of, analysis. 

For purposes of describing the products available to perform such complex 
^^analysis, it is useful to think in terms of three 'basic types: costing, 
Simulation, and opti-mization. NCHEMS has perhaps done as much v/ork .as 
any agency in developing costing procedures fojr posts econdary education. 
Early procedural developments were part of aRost Finding Principles 
project (Topping, 1974); and widespread implementation v/as seen througli ^ 
the 'Information Exchange Procedures pro^ject (Johrlson and Huff, 1975). 
These efforts are being expended through the Major Research Universities 
Component of the Information Exchange Procedures project v/here attention 
1s .addressed toward the unique problems experienced by large complex 
institutions in deriving cost information. Vihereas the earlier efforts 
focused on defining, through simple conventions, the average cost per 
student credit hour (and in turn FTE student), further developmental 
work is beginning to consider the more difficult is-sues of marginal 
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/ costs and- joktly incurred cost. The'latter situation occurs when one 
^ expenditure of resources results^ in more than one valued outcome. An 
■ Example is a joint faculty-student research activity, which has value 

both as gra'd/ate credit for instruction .and as research pe- se. Addi- 
' .tional citing '^o-rk has been done in the health' field, mostly by the 
A^socWtion of Air.erican Medical Colleges (1971), and the Institute of 
Medicine (1974). These approaches are similar to the cost finding prin- 
ciples approaches in determining average costs, although they are more ^ 
focused to the peculiarities of the medical school setting. 

Many different- vendors have computer simulation products avaiOable. 
Among this group are NCHEMS with its Resource Requirements Prediction 
Model (RRPM) (Gulko, 1971), the Systems Research Group with tfteir'CAMPUS 
Model (Judy, 1969), Peat Marwick and Mitchell wi>h their SEARCH Model 
CKeane and Daniel, 1970), and the Midwest Research Institute with their 
HELP/PLANTRAM Model (McKelvey, 1970). GenerallTT^kihg , each of these 
models builds from som? ■type_„o_f_.costing methodology to project the impact 
of future decisions. A frequent criticism of these approaches is that 
they force the planner to make assumptions that the future wiVl continue 
liiuch as the present in terms of operational relationship of the production 
. function Nevertheless, each of these models is useful in .allowing\he 
state; planner to estimate the impact of current decisions at a macro Jevel 



more complete description of the criticism of simulation models is provided 
by Schroeder (Schroeder, 1975, pp. 701-702). 
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Over the past several years increasing attention has been given to 

applying mathematical programming techniques, and particularly linear 

programming and goal' programming, to the management problems in post- 

secondary education. As a rule, these approaches recognize a broader 

range of avaiUWe options and constraints facing the academic planner 

than do simulation models and they permit the planner' to adjust the 

Mi 

relative quantities of input resources such that t-he optirffal level of 

output might be obtained. Appraoches developed by Weathersby (1970), 

Wagner and Weathersby (1971), Wallhaus (1971 )', Lee and Clayton (1972),^ 

Tixrksen and Hoi zman (1970), and Andrew and Collins (1971) are represen- 

'12 ' 

tative efforts in this field. To facilitate the implementation of these 
approaches at the state level, NCHEMS has develope^d-a Stale Planning 
System (SPS) which was previously known as the State Postsecondary Educa- 
^tion Planning Model (SPEPM). SPS (Bassett, et. al., 1977) is a software 
package v/hich allows the state-level planner to establish design equa- 
tions which describe the activity under study. Then, the planner can . 
call upon a broad range of mathematical approaches including linear 
programming to assess, and in some cases, optimize in a mathematicaV 
sense, the relationships among the many variables: Other NCKEMS .acti vi- 
ties include the State Nursing- Model (Sauer; et. al., 1977) and the 
Ef^ficient Surfaces Model (Gray, forthcoming). The former assists, in 
evaluation of alternative training strategi^es for fulfilling a state's 
manpower needs fn nursing while the latter seeks to identify the^^optimal ' 
mix of academic resources in fulfilling a^mission. 
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''^ScH^oeder has provided a morp comDlete description of mathematical ^programmi 
y appr.oa'ches (Schrbeder, 1973, pp. 900-902). 
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E/, Summary of Analytic Techniques , ^ , v 

. • ' J 

- If\ this section of the p^per we have attemp^d to, provide a sampling-of 
the many analytic approachel^ava liable to' the state-level academi-c planner. 
While our listings are in no -way exhaustive, they do provide an introduc-' 

\-tion to the types of capabil'ities which currervt^y are available. The 
approaches were presented in a hierarchial framework ranging from tlie 
more -basic applications to those which' are of considerable ma-thematical 
complexity and require large computer systems.' Depending^ on the types 
of proble.ms under analysis, the coirjnitment of the agency to the analytic 
proces-s, and t.he .size and level of expertise of the planning staff, the 
appropriate procedure can be identified, 

IV\ Summary and Impli.catfons for Fi>feyre Development 
A.' Overview 



A summary of the\arious uses of informational and analytic techniques 
i^n^staJi^- level ^ostsecondary education planning requires comments alon^' 
two dimensions: the typ'es of techniques 'i.n.use and the degree of their 
utiliza'tion'r' Product developtjient to date' has fol lowed a somewhat predic-" 
table pattern. A, good portion of the efforts tjius far have been to 
develop a 'communications base"— a standard language in' the form "of 
information standar.ds for planning and management. Without this necessary 
framework for relating phenomenon and the specification and definition of 
data Elements, ,the overall analytic proress would'be hollov/. Although the' 
planner is usually concerned with both the efficiency and the effectiveness 



ERIC 



30 , 



-29- 



r 



6f the constituent insti.tutions , most of the devQl ppmental v/ork thus far 
has been focused on the former criterion. This is due in large^p^rt to 
the fact^that cost determination and related issues are easier to address 
•tnan those effectiveness measures which require value judgements. 



The utilization of informational and analytic techniques vary v/idely 
ffom state to state, and in some cases among agencies within a state. 
Although little systematic effort has be.en directed toward understanding 
this utilization thus far, it is believed that utilization vanes m 
accordance to the legal role 'of the state-^evel agency, the size and 



capability of the agency^staf f , and the political forces operative 
13 

withiaj^e state. Not only has the extent of utilization varied by 
state, but also the decree of success in the use of these approaches has 
differed widely. Success patterns may be explained by the utilization 
factors just mentioned, the readiness of the state to apply a particular 
approach in an evolutionary sense (cost studies without an adequate com- 
munications base), and the appropriateness of the tool for the context 
in which it is appl ied. 
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The state of the. art can.be summarT^Ked through observing that zhe most 
advanced tools available to industrial management (costing, simciTation, 
optimi2tng) are also available in some form to higher edikiation adminis- 
tration. However., even the most advanced state agencies fall short in 
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The differences and responsibilities in orientation between coordinating 
boards and governing boards has been jpQted in Millett, pp. 62-66). 
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applying the available technology. , Furthermore, most state. agencies lag 
significantly behind the forefront of developmeatal efforts in their 
readiness and willingness to utilize such .techniques . 



B. Needed Developmental Activities 

Although some needed technic3.radvances can be identified, most of the 
important developmental work over the next few' years is likely to incor- 
porate a behavioral science approach to understanding the '1 imitations in 
the use^df these technii^ues for state-level academic planning. As sug- • 
gested in the previous paragraphs, no-sta*te agency is employing the full 

, technology,' and the vast majority of such agencies fall -significantly short 

, in their utilization of infonnational and analytic planning approaches. 
While it would be convenient to ascribe the' situation to the lack of 
adequate 'staffing in the state-l^el agencies, it probably is more realis-- 
tic to bel-ieve that many of the/available approaches fail to satisfy sign'i- " 

^ficant dimensions of need of the £tate-level 'planner. ""^ In tjie coming years, 
much greater attention is likely to be placed'on matching the .available 
technologies with the different coatex-ts .and problems in stench a't the 
sta^e level. Such modifications could recognize the di^fference in function 
of the state-level agency (governing, coordinating, community college, etc.), 
the relative degree of rigor to which the planning approach must satisfy, 

'and other environmental variation. \ - 



"'^This issue will be addressed in greater detail in a forthcoming NCHEMS staff 
paper '(.Caruthers, 1977). ' , ■ 



From a techaical perspective the most needed advance in efficiency 
.analysis are the requirements to assess more accurately incremental costs 
•*and to' find v/ays to link costs to outcomes. The limited value of average 
-cost information is becoming, more apparent with each successive applica- 
tion/ The more qualitative aspects of planning (e.g., outcomes measure- . 
ment and environmental jneasurement) also need further technical advance. 
We are only begiitning to understand how to collect, measure, and analyze 
^ * data in this arena. - - 

*» 

C- Summary . * ^ ' ' - 

Informational and analy-tic apprpaches have much, to offer the state-level 

academic planner. While such approaches, do not yet reach perfection, the 

' evidence of' our experiences to date suggests that any state-level post- 
er, 

se£ondary education agency could perform its job more effectively through 
discriminate use of the available technology- Through this paper we have 
attempted to increase an awareness of how data, analytic techniques, and 
their produpt information should be used to assist in state-level acaderrngQ 
planning. Further, we have offered an. introdu^:tion to the available ^ 
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This contention is supported by the results of a survey .conducted during 

the flACUBO Costing Conference held in Miami, Florida during January, 1977. 
The topic, "Determination of Cost and Revenue Behavior", was ranked highest 
among eleven topics identified a^ potential areas for investigation through 
NACUBO and NCHEMS'jotnt costing efforts. ^ c , 

16 ' ^ 

Evidence for these assertions can be found in the analysis of the question- 

^ naires sent to participants of this seminar. Program Review and Academic^ 
Quality headed tjie list of 23 ar'eas of interest to st^te-level academic \' ' 
officers. ' ' . 
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products for collecting and structuring data and to t/ree general levels 
of anajytic capability. Finally, we have attemptjiT.to identify some of. • 
the shortcomings in the current approaches that we have identified, and 
wjf^have suggested how these shortcomings might be ameliorated in- the 
coming years. t 
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